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Title of the Invention 

Image transmission device and storage medium with program for 
realizing its function, image display device and storage medium with 
program for realizing its function, and image transmission/ reception 
system 

Background of the Invention 

Field of the Invention 

The present invention relates to an image transmission device 
and a storage medium with a program for realizing its function, an image 
display device and a storage medium with a program for realizing its 
function,/ and image transmission/ reception system which are capable 
of preventing the image data from being tampered with and ensuring the 
originality. 

Recently, more and more companies are taking what is called a 
paperless measure capturing documents, checks and the like as image 
data and corresponding the data by using a network system. However, 
the development of computer pertinent art helps the paperless measure, 
on the other hand, enables the image data to be easily tampered with. 

Description of the Related Art 

In the conventional paper culture, marks, stamps, signs and the 
like are used to ensure that the documents and checks are not tampered 
with, in other words, to ensure the originality. Also, a watermark is used 
on, for example, bills, gift certificates, official documents or the like to 
ensure the originality. Considering this point, some kind of measure 
needs to be taken to ensure the originality of documents and checks in 
taking the paperless measure mentioned above. 

A part of image data can be easily tampered with having no visual 
evidence by being electronically processed. Consequently, it is difficult to 
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ensure the originality only by putting marks, stamps, signs and the like 
on a part of the image data as in the conventional paper culture. 
Therefore, ensuring the originality is conventionally achieved by 
calculating a hash value from the coded-image data and by embedding 
an electronic watermark in the coded-image data. The hash value and 
the electronic watermark enable to judge whether the image data are 
tampered with or not in decoding the image data when even a part of the 
image data are tampered with. 

Meanwhile, the stamps, the signs or the watermarks in the paper 
culture can be visually confirmed and it can be judged easily and 
immediately that the stamps, signs or watermarks, are not tampered 
with. However, when the electronic process in which the hash value and 
an electronic watermark are used is used, judgement cannot be easily 
achieved since a specific process, for example, operating a decoder is 
necessary to judge whether the image data are tampered with or not. 

Also, in using the electronic watermark, if the algorithm for 
embedding the electronic watermark is analyzed, the electronic 
watermark might be embedded by using the algorithm after a randomly 
chosen image data are tampered with. Since image data with an 
electronic watermark embedded ensure that the image data are not 
tampered with, the art of electronic watermark makes it all the more 
difficult to detect that the image data are not tampered with. 

Summary of the Invention 

The present invention has been achieved in views of 
aforementioned problems possessed by the conventional method for 
preventing the image data from being tampered with, and an object of 
the present invention is to provide a novel and improved image 
transmission device and image display device capable of preventing 
easily the image data from being tampered with and of confirming the 
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originality of the image data visually. 

To achieve the above object in the present invention, there is 
provided an image transmission device transmitting: a first coded-image 
data with a first image coded; and a second coded-image data with a 
coded second image, which is displayed over the first image and changes 
the form in the case of the first coded-image data tampered with. 

The image transmission device can comprise: first image coding 
means for coding the first image; hash value operation means for 
calculating the hash value of the first image; second image coding means 
for coding the second image; encryption means for encrypting the 
second coded-image data by using the hash value of the first image as a 
key; and transmission means for transmitting the first coded-image data 
and the encrypted second coded-image data. 

Also in the present invention, there is provided a storage medium 
wherein the program for realizing the function of the image transmission 
device is stored. 

Further in the present invention, there is provided an image 
display device displaying in piles: a first image which is achieved by 
decoding the first coded-image data; and a second image which is 
achieved by decoding the second coded-image data and changes the 
form in the case of the first coded-image data tampered with. 

The image display device can comprise: data acquisition means 
for acquiring the first coded-image data and the encrypted second 
coded-image data; first image decoding means for decoding the first 
coded-image data; hash value operation means for calculating the hash 
value of the decoded first image; decryption means for decrypting the 
encrypted second coded-image data by using the hash value of the first 
image as a key; second image decoding means for decoding the 
decrypted second coded-image data; and image combination means for 
combining the decoded first image with the decoded second image. 
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Also in the present invention, there is provided a storage medium 
wherein the program for realizing the function of the image display 
device is stored. 

Further in the present invention, there is provided an image 
transmission/ reception system comprising the image transmission 
device and the image display device, between which the first image and 
the second image are transmitted/ received. 

Brief Description of the Drawings 

The above and other features of the invention and the 
concomitant advantages will be better understood and appreciated by 
persons skilled in the field to which the invention pertains in view of the 
following description given in conjunction with the accompanying 
drawings which illustrate preferred embodiments. In the drawings: 

Fig. 1 is a chart illustrating an embodiment of an image 
transmission device. 

Fig. 2 is a chart illustrating a transition of data on the image 
transmission device shown in Fig. 1 . 

Fig. 3 is a chart illustrating an embodiment of an image display 

device. 

Fig. 4 is a chart illustrating a transition of data on the image 
display device shown in Fig. 3. 

Detailed Description of the Preferred Embodiment 

Hereinafter, the preferred embodiment of the present invention 
will be described in reference to the accompanying drawings. Same 
reference numerals are attached to components having same functions 
in following description and the accompanying drawings, and a 
description thereof is omitted. In addition, a mark image means marks, 
stamps, or signs which are used to ensure that the image (coded-image 
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data) are not tampered with. 

In the embodiment, there is provided an image transmission 
device transmitting: a coded-image data with an image coded; and a 
coded-image data with a coded mark image, which is displayed over the 
image and changes the form in the case of the image data tampered with. 
An embodiment of the image transmission device will be described in 
reference to Fig. 1 . 

(Image Transmission Device 10) 

The image transmission device comprises: image coding means 
101 for coding an image AO; hash value operation means 102 for 
calculating the hash value H of the image AO; mark image coding means 
103 for coding a mark image BO; encryption means 104 for encrypting 
mark coded-image data B 1 by using the hash value H of the image AO as 
a key; and transmission means 105 for multiplexing and transmitting 
coded-image data Al and the encrypted mark coded-image data B2, as 
shown in Fig. 1. 

The image coding means 101 is means for coding an image AO 
input from an image input terminal 1 . Such international standards for 
coding multi/bi-level still images as JPEG (Joint Photographic Coding 
Experts Group) and JBIG (Joint Bi-level Image Coding Experts Group) 
are used as a coding hereon. The input of the image AO from the image 
input terminal 1 may be achieved through a network or by reading from 
such a storage medium as CD-ROM (Compact Disk Read Only Memory) 
and DVD (Digital Video Disk). 

The hash value operation means 102 is means for calculating the 
input hash value H of the image AO. Such algorithms as MD5 (Message 
Digest 5) and DSA (Digital Signature Algorithm) are used as a hash value 
operation hereon. 

The mark image coding means 103 is means for coding an image 
B0 input from a mark image input terminal 2. Such international 
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standards for coding multi/bi- level still images as JPEG and JBIG are 
used as a coding hereon, as used on the image coding means 101. 
Alternatively, the image AO and the mark image BO may be coded 
concurrently by only one image coding mean comprised in the image 
transmission device 10. The input of the image BO from the mark image 
input terminal 2 may be achieved through a network or by reading from 
such storage media as CD-ROM and DVD. 

The encryption means 104 is means for encrypting the mark 
coded-image data B 1 , which are coded by the mark image coding means 
103, by using the hash value H calculated in the hash value operation 
means 102 as a key. Such symmetric key cryptographs as DES (Data 
Encryption Standard) and Triple DES are used as an encryption hereon. 

The transmission means 105 is means for multiplexing the 
coded-image data Al which are achieved by the image coding means 101 
and the encrypted mark coded-image data B2 which are achieved by the 
mark image coding means 103, and for transmitting as multiplexed 
coded-image data C. There are such means for multiplexing hereon as 
multiplexing as image data in different area, for example, JBIG2, and for 
storing in a comment area as binary data. The output of the multiplexed 
coded-image data C from a data output terminal C may be achieved 
through a network or by writing in such storage media as CD-ROM and 
DVD. 

In the embodiment, although an explanation as to the case of the 
transmission means 105 with a function of multiplexing and 
transmitting data will be provided, the function of multiplexing data are 
not necessarily essential. The coded-image data Al and the encrypted 
mark coded-image data B2 may be transmitted as separate data each. 

The image transmission device 10 can be realized in software as 
well as hardware, each of which has the function of the image 
transmission device as a specific function. In other words, especially in 
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the case of the software, the function of the image transmission device 
10 can be realized by reading from, the storage medium with the program 
for realizing the function of the image transmission device 10 into a 
computer terminal in general use. 

Next, an action of the image transmission device 10 will be 
described in view of a data transition in reference to Fig. 2. 

The image AO input from the image input terminal 1 is coded by 
the image coding means 101 while the hash value H is calculated in the 
hash value operation means 102. On the other hand, the mark image B0 
input from the mark image input terminal 2 is coded by the mark image 
coding means 103. 

The mark coded-image data Bl, which are coded by the mark 
image coding means 103, are encrypted by using the hash value H 
calculated in the hash value operation means 102 as a key. 

The coded-image data Al and the encrypted mark coded-image 
data B2 are multiplexed by the transmission means 105 and are output 
from a data output terminal 3 as multiplexed coded-image data C. 

In the embodiment, there is provided an image display device 
displaying in piles: an image which is achieved by decoding coded-image 
data; and a mark image which is achieved by decoding mark coded- 
image data and changes the form in the case of the coded-image data 
tampered with. An embodiment of the image transmission device will be 
described in reference to Fig. 3. Also, the embodiment will be described 
on the assumption that the image display device 20 receives the 
multiplexed coded-image data C transmitted from the image 
transmission device 10. 

(Image Display Device 20) 

The image display device 20 comprises: data acquisition means 
106 for receiving the multiplexed coded-image data C transmitted from 
the image transmission device 10 and for dividing the multiplexed 
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coded-image data C into the coded-image data Al and the encrypted 
mark coded-image data B2; image decoding means 107 for decoding the 
coded-image data Al; hash value operation means 108 for calculating 
the hash value H of the decoded image AO; decryption means 109 for 
decrypting the encrypted mark coded-image data B2 by using the hash 
value H of the image AO as a key; mark image decoding means 110 for 
decoding the decrypted mark coded-image data Bl; and image 
combination means 111 for combining the decoded image AO with the 
decoded mark image BO. 

The data acquisition means 106 is means for receiving the 
multiplexed coded-image data C transmitted from the data output 
terminal 3 of the image transmission device 10 and for dividing the 
multiplexed coded-image data C into the coded-image data Al and the 
encrypted mark coded-image data B2. In the embodiment, although an 
explanation as to the case of the image display device 20 with a function 
of receiving and dividing the multiplexed coded-image data C will be 
provided, the function of dividing the multiplexed coded-image data are 
not necessarily essential in the data acquisition means 106 when the 
coded-image data Al and the encrypted mark coded-image data B2 are 
transmitted as separate data each. The input of the multiplexed coded- 
image data C from the data input terminal 4 may be achieved through a 
network or by reading from such storage media as CD-ROM and DVD. 

The image decoding means 107 is means for decoding the 
coded-image data Al. Decoding hereon is assumed to be the function 
corresponding to that of the image coding means 101 in the image 
transmission device 10, and the image AO is achieved by decoding the 
coded-image data A 1 . 

The hash value operation means 108 is means for calculating the 
hash value H of the image AO achieved by the image decoding means 107. 
Such algorithms as MD5 and DSA are used as a hash value operation 
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hereon as in the hash value operation means 102. 

The decryption means 109 is means for decrypting the mark 
coded-image data B2, which are encrypted by the data acquisition 
means 106, by using the hash value H calculated in the hash value 
operation means 108 as a key. Decryption hereon is assumed to be the 
function corresponding to that of the encryption means 10 1 in the image 
transmission device 10, and the coded-image data Bl are achieved by 
decrypting the encrypted mark coded-image data B2. 

The mark image decoding means 1 1 0 is means for decoding the 
mark coded-image data Bl achieved by the decryption means 109. 
Decoding hereon is assumed to be the function corresponding to that of 
the mark image coding means 103 in the image transmission device 10, 
and the mark image B0 is achieved by decoding the mark coded-image 
dataBl. 

The image combination means 1 1 1 is means for combining the 
image AO which is decoded by the image decoding means 107 with the 
mark image B0 which is decoded by the mark image decoding means 
110. Such means as AND operation, OR operation, addition and 
replacement are used as combination means hereon. An image D with 
the combination of the image AO and the mark image B0 is output from 
an image output terminal 5, and is displayed or printed out to be 
visually confirmed. 

The image display device 20 can be realized in software as well as 
hardware, each of which has the function of the image display device as 
a specific function. In other words, especially in the case of the software, 
the function of the image display device 20 can be realized by reading 
from the storage medium with the program for realizing the function of 
the image display device 20 into a computer terminal in general use. 

Next, an action of the image display device 20 will be described in 
view of a data transition in reference to Fig. 4. 
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The multiplexed coded-image data C are received by the data 
acquisition means 106 with the function of dividing the multiplexed 
coded-image data, and are divided into the coded-image data A 1 and the 
encrypted mark coded-image data B2. 

The coded-image data Al are decoded by the image decoding 
means 107. The hash value H of the decoded image AO is calculated by 
the hash value operation means 108. 

The encrypted mark coded- image data B2 are decrypted by using 
the hash value H of the image AO as a key, and the decrypted mark 
coded-image data Bl are decoded by the mark image decoding means 
110. 

The image AO which is decoded by the image decoding means 
107 and the mark image B0 which is decoded by the mark image 
decoding means 110 are combined (overlaid or multilaid) by the image 
combination means 111. The image D with the combination of the image 
AO and the mark image B0 is output from the image output terminal 5. 

In Fig. 4, since the image AO is not tampered with and the hash 
value is correct, a proper mark image is displayed on the output image D. 
When even a part of the image AO is tampered with, a hash value H' 
which is different from the hash value H is calculated by the hash value 
operation means 108, according to the nature of hash value operation. 
Since the mark image, which is decrypted by using the hash value H' as 
a key and decoded, becomes a different image (noise) from the proper 
mark image B0 or cannot be decoded properly, the mark image cannot 
be acquired. After this manner, the originality of the image data can be 
confirmed visually and easily. 

According to the image transmission device 10 and the image 
display device 20 as described in the embodiment, when even a part of 
the image is tampered with, a hash value H' of the image which is 
tampered with becomes different from the hash value H which is not 
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tampered with. In other words, when even a part of the image is 
tampered with, the coded-image data of the mark image which is 
decrypted by using the hash value as a key become different from the 
coded-image data of the mark image which is not tampered with. 
Consequently, the mark image finally achieved enables to judge visually 
and easily whether the image data are tampered with or not. 

Although the preferred embodiment of the present invention has 
been described referring to the accompanying drawings, the present 
invention is not restricted to such examples. It is evident to those skilled 
in the art that the present invention may be modified or changed within 
a technical philosophy thereof and it is understood that naturally these 
belong to the technical philosophy of the present invention. 

In the present invention as described above, the image data can 
be prevented easily from being tampered with and the originality of the 
image data can be confirmed visually. 



